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O ■ Abstract 



C/3 



We introduce a simple, discrete model of Feynman's ratchet and pawl, op- 
erating between two heat reservoirs. We solve exactly for the steady-state 
directed motion and heat flows produced, first in the absence and then in the 
C^ . presence of an external load. We show that the model can act both as a heat 

C . engine and as a refrigerator. We finally investigate the behavior of the system 

i-^ I near equilibrium, and use our model to confirm general predictions based on 

C ' linear response theory. 
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INTRODUCTION 

Feyninan's ratchet and pawl system [^ is a well known (but not the earliest! |0]) example 
of a proposed "mechanical Maxwell's demon", a device whose purpose is to convert into 
useful work the thermal motions present in a heat reservoir. The idea is beautifully simple: 
set up a ratchet and pawl so that a wheel is allowed to turn only in one direction, then attach 
that wheel to a windmill whose vanes are surrounded by a gas at a finite temperature; see 
Fig. 46-1 of Ref. [|1|. Every so often, an accumulation of collisions of the gas molecules against 
the vanes will cause the wheel to rotate by one notch in the allowed direction, but presumably 
never in the forbidden direction. Such rectification of thermal noise could be harnessed to 
perform useful work (such as lifting a flea against gravity), in direct violation of the Second 
Law. Of course, in order for statistical fluctuations to cause rotation at a perceptible rate, 
the ratchet and pawl must be microscopic, and this points to the resolution of the paradox. If 
thermal motions of the gas molecules are sufficient to cause the wheel to rotate a notch, then 
the thermal motion of the pawl itself will occasionally cause it to disengage from the ratchet, 
at which point the wheel could move in the "forbidden" direction. Feynman compared the 
rates of the two processes - rotation in the allowed and the forbidden directions - and found 
them to be equal when the system is maintained at a single temperature. Thus no net 
rotation arises, and the Second Law is saved. 

Since the failure of the ratchet and pawl system to perform work arises from thermal 
fluctuations of the pawl, a natural solution to the problem is to reduce these fluctuations by 
externally cooling the pawl to a temperature below that of the gas. In this case the device 
does indeed operate as designed, but this no longer constitutes a violation of the Second 
Law: the ratchet and pawl is now effectively a microscopic heat engine, capitalizing on a 
temperature difference to extract useful work from thermal motions. 

While the ratchet and pawl was introduced in Feynman's Lectures primarily for peda- 
gogical purposes, recent years have seen a renewed interest in this system p|-p^, largely 
due to the fact that analogous mechanisms have been proposed as simple models of motor 
proteins. 

Our purpose in this paper is to introduce an exactly solvable model of Feynman's mi- 
croscopic heat engine. This model is discrete rather than continuous^, but it captures two 
essential features of the original example: (1) a periodic but asymmetric interaction poten- 
tial between the ratchet and the pawl (corresponding to the sawtooth shape for the ratchet's 
teeth), and (2) two "modes" of interaction (corresponding to the pawl being either engaged 
or disengaged from the ratchet). These features are sufficient for the model to reproduce 
the behavior discussed by Feynman. Related discrete models of noise-induced transport 
have appeared in the literature [^^-|TB|; however, we believe ours to be the first exactly 
solvable model in which (as in Feynman's example) the transport is explicitly driven by a 
temperature difference between two reservoirs. 

In Section |, we will introduce our model - a system in contact with two heat reservoirs - 



^ Note that a particle (or, more generally, a reaction coordinate), evolving from one sufficienctly 
deep potential (or free) energy minimum to another, behaves much as if hopping from one site to 
another on a discrete lattice. See, for instance, Fig. 6 of Ref. [f^. 



and consider it in the absence of an external load. We will solve for the net rate at which the 
device produces directed motion, in terms of the reservoir temperatures T^ and Tg (Eq.|l^). 
We will also solve for the net rates of heat flow from reservoir A to the system, and from 
the system to reservoir B; see Fig.^. For zero external load, these rates, Qa and Qb, must 
be equal, as we will indeed find them to be. We will finally use these results to solve for the 
entropy production rate. 

In Section |I^, we will allow the device to perform work against an external load, /. We 
will again solve exactly for the directed motion and heat flows, in terms of x = {j^TaiTb)- 
In this situation, the heat flows Qa and Qb are not necessarily equal; the difference between 
them is the power, W, which the device delivers against the load /. When W > 0, the system 
operates as a heat engine. Conversely, one can imagine that for some parameter values, the 
system will operate as a refrigerator, creating a net flow of heat from the colder to the hotter 



reservoir. In Section |ITT| we will use our analytical results to show that our model indeed 
exhibits both these behaviors (heat engine and refrigerator). Finally, in Section |V| we will 
consider the near-equilibrium regime of small load and temperature difference. We will show 
that our model confirms general predictions based on linear response theory. 



I. ZERO EXTERNAL LOAD 

Consider a particle which jumps between neighboring sites along a one-dimensional reg- 
ular lattice, where d is the lattice spacing. We assume that the particle is coupled to 
a heat reservoir at temperature Tg, and that its jumps are thermal in nature. That is, 
the probability (per unit time) of making a jump to site i + 1, starting from site i, is re- 
lated to the probability rate of the inverse process by the usual detailed balance relation: 
Pi^i+i/Pi+i^i = exp(— Ai^/Te), where AE = f/j™{ — 11^ is the instantaneous change in 
the particle's potential energy, associated with the jump from i to i + 1. We use the notation 
C/j to denote the potential energy of the particle at site i; the superscript m denotes the 
"mode" of the potential, to be explained momentarily. The integer index i runs from — cxo 
to +00, and we are using units in which Boltzmann's constant fc^ = 1- 

Next, we assume that the potential energy function f/j has two possible modes, m = 
1,2, and that it changes stochastically between these two. In the first mode, the energy of 
each site is zero: t/j = 0. In the second mode, the energy is periodic: U\ = a- [{i mod 3) — 
1], where a is a positive constant with units of energy. As shown in Fig.|l|, the second mode 
is a discrete version of an asymmetric sawtooth potential. We assume that the stochastic 
process governing the changes between modes is also a thermal process, driven by a heat 
reservoir at temperature Ta- Thus, the probability rate of a change to mode 2, starting from 
mode 1, relative to the probability rate of the reverse mode change, is given by the detailed 
balance factor exp(— A^E/Ta), where AE = U\ — U\ is now the (site-dependent) change 
in particle energy due to an instantaneous change from mode 1 to mode 2. 

We now describe more precisely these two stochastic processes, governing the jumps of the 
particle, and the change between modes. We assume the processes are independent, and each 
is a Poisson process occurring at a rate F. That is, during every infinitesimal time interval 
5t, there is a probability F^t that the particle will attempt a jump to a neighboring site. An 
"attempt" looks as follows. First, the particle decides (randomly, with equal probabihty) 
whether to try jumping to the left {—d) or to the right {+d). Then the Metropolis algorithm 



23| is used to satisfy detailed balance: if the value of AE" associated with the jump is zero 
or negative, then the jump takes place; if /\E > 0, then the jump occurs with probability 
exp(— Ai^/Tg). Similarly, during every infinitesimal time interval 6t, there is a probability 
T6t that the mode will attempt to change, and the attempt is accepted or rejected according 
to the Metropolis algorithm (at temperature T^). 

We have introduced three parameters which we will view as being "internal" to the 
system: d, a, and F; these essentially set the relevant length (d), energy (a), and time (r~^) 
scales. The two remaining parameters T4 and Tb, we will view as "external". 

The analogy between our model and Feynman's ratchet and pawl runs as follows. First, 
the position of our particle corresponds to an angle variable, 6, specifying the orientation 
of the ratchet wheel. When the particle accomplishes a net displacement of three lattice 
sites, to the right or to the left, this is equivalent to the ratchet being displaced by one 
notch, or tooth^ see Fig.|l]. Since we want to keep track of the wheel over long intervals of 
time, possibly including many full rotations, 6 varies from —00 to +00, rather than being a 
periodic variable from to 27r. 

When a ratchet and pawl are "engaged" - that is, when the pawl actually presses against 
the teeth of the ratchet - then there exists an interaction energy, arising from the compression 
of the spring which holds the pawl against the ratchet, which has the form of a periodic 
sawtooth potential in the variable 6. In our model, the analogue of this interaction energy 
is the discrete sawtooth potential Ul , mode 2 thus corresponds to the situation in which 
the ratchet presses against the pawl. By contrast, mode 1 corresponds to the ratchet and 
pawl begin "disengaged" , as will occur every so often as a result of thermal fluctuations of 
the pawl. Of course, in Feynman's system, the potential energy of the disengaged mode is 
always greater than that of the engaged mode (due to the spring compression needed to 
actually place the pawl out of reach of the ratchet's teeth), whereas in our model this is 
not the case: U^ = 0. This, however, does not change the problem in any qualitatively 
significant way. 

As mentioned, the motion of the particle from site to site is a thermal process occurring 
at temperature Tb, while the stochastic "flashing" between modes occurs at temperature 
Ta- Thus, in the context of the analogy with the physical ratchet and pawl, Tg denotes the 
temperature of the gas surrounding the panes connected to the ratchet wheel, and T4 is the 
temperature at which the pawl is maintained. 

To analyse the model, we first note that it maps nicely onto the problem of a spin-1/2 
particle. A, coupled to a spin-1 particle, B, with the following energy function: 

E{SA,SB)=a-(^SA + ^ySB, (1) 

where Sa = ±1/2 and 5*^ = 0,±1. Here, spin A represents the mode (pawl), spin B 
represents the particle (ratchet). When spin A is "down" {Sa = —1/2), the energy of the 
system is independent of the state of spin B, as with mode 1; when spin A is "up", the 
energy is —a, 0, or +a, depending on the state of spin B, as with mode 2. Thus, changes 



^ Thus, the distance 3d in our model translates to an angular interval A^ = 2iT/Nteethi where 
Nfeeth is the number of teeth along the perimeter of the ratchet wheel. 



in the state of spin A correspond to changes in the mode, whereas changes in the state of 
spin B correspond to the particle making a jump. If Sb changes from -1 to 0, or from to 
+1, or from +1 to -1, then this amounts to the particle jumping to the right; the reverse 
processes (0 to -1, etc.) correspond to jumps to the left. We now couple spin A to a reservoir 
at temperature T4, spin i? to a reservoir at temperature Tb, with the stochastic dynamics 
as outlined above (two independent Poisson processes), and solve for the net drift of the 
particle. 

This system can be visualized as shown in Fig.^. Spin A flips between up and down; 
spin B performs sudden "rotations" by ±120°. A clockwise rotation corresponds to a jump 
to the right {+d) by the particle; counterclockwise ones translate into jumps to the left. 



Table 1. 



State (n) 


Sa 


Sb 


EiSA,SB) 
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-1/2 


-1 





2 


-1/2 








3 


-1/2 


+1 





4 


+1/2 


-1 


—a 


5 


+1/2 








6 


+ 1/2 


+1 


+a 



Our system has six possible states, listed in Table 1. The dynamics of the particle is 
described by a Markov process, for which we can write a set of rate equations. Let p„.(t) 
denote the probability that the system is found in state n at time t. Then 



dpn 
dt 
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(2) 



Here, F ■ P{n -^ n') is the probability rate at which the system, when its state is n, makes a 
transition to state n'. If the transition n ^ n' involves only a flip of spin A, then P{n -^ n') 
is the probability that such an attempt will be accepted, under the Metropolis rule. If the 
transition involves just a rotation of spin B (by ±120°), then P{n -^ n') is the probability 
of generating this move, given an attempt to change Sb- If the transition involves changes 
in the states of both spins, then P{n -^ n') = 0. Examples of these rules are: 
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(3) 



The factors of one-half come from the fact that, when the system attempts to rotate spin 
B, there are two possible states for which it can aim. 

Our rate equations can be expressed as: dp/dt = TTZp, where p = (pi, ■ ■ ■ ,P6)'^, 
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(4) 



and we have introduced the constants 

^ = g-"/TA and i/ = e-"/^«. (5) 

Note that /i and v are monotonically increasing functions of T^ and Tg, and the temperature 
range < T^ (Tg) < oo translates to < /i (i/) < 1. We thus think of /i and z/ is "rescaled" 
temperatures. 

The long-time behavior of our system is governed by the steady-state distribution of 
probabilities, p, which is the null eigenvector of Tt (i.e. T^p = 0). Determining p is an 
exercise in Jordan elimination, and leads to the following result: p = x/A^, where 

xi = 52/i + 28/i^ + 12z/ + 19z/2 + 5z/^ + 21/iz/ + 2^v^ + S/x^z/ (6) 

X2 = 36;U + 16/i^ + 28z/ + 27z/2 + 5z/^ + 25/iz/ + S/iz/^ + 2/iV (7) 

X3 = 44/i + l^^v + 20z/ + 49z/2 + 15i/^ (8) 

X4 = 64 + 20z/ + 48/i + 15/iz/ (9) 

X5 = 24/i + 40z/ + 20z/2 + IS/i^ + 30/iz/ + IS/iz/^ (10) 

xe = 22/^2 + 16/ii/ + 44^z/2 + 14/i2iy + I5^zy3 + 26//^ + lOz/^ (11) 

and A^(yU, z/) = I]^=i ^^j is a normalization factor. 

When both temperatures go to zero, /i, i/ — > 0, we get p"^ = (0, 0, 0, 1, 0, 0). This makes 
sense: in that limit, the system freezes to the state of lowest energy, n = 4. 

We now address the question of net drift. We first define a net current, J = J^ — J^, 
where J+ is the rate at which spin B is observed to change from state to state -|-1, and J_ 
is the rate of the reverse transitions, from -|-1 to 0. This can be interpreted by imagining an 
observer placed at 2 o'clock on the clock face depicting spin B in Fig.|^; J+ (J^) is then the 
rate at which the hand of the clock passes that observer in the clockwise (counterclockwise) 
direction; by "rate" , we mean number of passes per unit time, averaged over an infinitely 
long interval of time.0 The current J represents the net average rate of clockwise revolutions 
of spin B. Since each revolution corresponds to 3 steps of the particle to the right, this 
translates into a particle drift: 

v = 3dJ, (12) 

where v denotes the (steady-state) average velocity of the particle. 
Explicit expression for the quantities J± are given by: 

J+ = T (p2^32 + P5^65) (13a) 

J„ = ^(p37^23 + P67^56)• (isb) 

(Since TTZmn is the transition rate to state m, given that the system is found in state n, 
pn^'R-mn is the net rate at which transitions from n to m are observed to occur in the steady 
state.) Using our results for p, we get, after some algebra: 



3 Of course, we could just as well have placed our observer at 6 or 10 o'clock; in the steady state, 
the current measured will be independent of where the observer is placed. 
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t;(T^,TB) = -3d^(/i-z/)(l-z/)(3/i + 4). (14) 

There are a number of things to note about this result. First, it imphes that if Ta > Tb 
(i.e. /i > z/), then there is a net flow of the particle to the left; if Tb > Ta, the particle drifts 
to the right. If Ta = Tb, then there is no drift, in agreement with Feynman's analysis (as 
well as the Second Law!). 

Next, notice that v —>■ as Tb —>■ oo {u ^ 1) . In that limit, the change in energy arising 
from a jump to the left or to the right becomes negligible in comparison to the temperature 
of the reservoir which drives those jumps; thus, from any lattice site, the particle is as likely 
to jump to the left as to the right, resulting in no net drift. 

Finally, in the limit T^ — > oo (yU ^ 1), we get: 

v = -2ld^{l-uf , Ta ^oo. (15) 

This is the limit in which changes between the modes occur independently of location of the 
particle: every attempt to change the mode is accepted. This is analogous to the situation 
studied by Astumian and Bier |^, where the "flashing" between the two modes of the 
potential is a Poisson process independent of the particle position. 

We can also compute the average rates at which heat is transferred between the two 
reservoirs and our system. Whenever the system makes a transition from state 1 to state 4, 
or from state 6 to state 3, its energy drops by a; this energy is released into the reservoir at 
temperature Ta- Conversely, during the transitions 4 — > 1 and 3-^6, the system absorbs 
energy a from reservoir A. The net rate at which the system absorbs energy from reservoir 
A is then: 

Qa = aF (p47^i4 + P3^63 - Pi'R'ii - Pe^ae) • (16) 

We can similarly write down an expression for the rate at which heat flows from our system 
to reservoir B: 

Qb = aV (p^TZ^^ + PqIZ^q + ^PqTZ^q - ^4^54 - ^5^65 - '^PaT^ga)- (17) 



Fig.^ illustrates the sign convention which we choose in defining Qa and Qb- Plugging in the 
values for the components of p and TZ, we find that Qa = Qb, as we could have predicted, 
since in the steady state there is no net absorption of heat by the system, nor is any of the 
heat delivered as work against an external load. Thus, the particle drift is driven by a net 
passage of heat from A to B, by way of the system. The explicit expression for this heat 
flow is: 

QA^B = QA = QB = 3—{fi-u)P{fi,u), (18) 

where P(/i, z/) = 4 + 14/i + 15i^ + 4/iz/ + 5z/^ > 0. The ratio v/Qa-^b then gives us the average 
displacement of the particle, per unit of heat passed (via the system) from reservoir A to 
reservoir B: 

li,„ ^ = ^i^ = -ii . (iz^^0(3M + 4) ^ ^ 



Here, Ax and AQ are the net particle displacement, and the net heat transferred from A to 
B, over a time interval r. The factor (/x — u) in Eq.|l^ guarantees that the direction of the 
heat flow is from the hotter to the cooler reservoir. 

We can also compute the rate at which entropy is produced during this process. The 
rate of entropy production associated with the flow of heat from reservoir A to the system 
is: Sa = —Qa/Ta', and for reservoir B: Sb = Qb/Tb- The net entropy production rate is 
thus: 

S = Sa + Sb = ^trJ'' QA-.B (20) 

J-A-l-B 

= 3^(ln^)(/x-z.)P(/i,z.)>0. (21) 

Figs.^ and ^ illustrate the results obtained in this section. Fig.^ is a contour plot of the 
drift f , as a function of the rescaled reservoir temperatures ^ and v. The contour f = runs 
along the diagonal, ^ = v, as well as along v = 1 {Tb -^ C)o). The appearance of positive 
contours {y > 0) to the left of the diagonal, and negative ones to the right, illustrates the 
point that the drift is rightward when Tb > Ta and leftward when Ta > Tb- 

In Fig.H we have fixed the value of Ta by setting /i = 1/2, and have plotted v, Qa^b, 
and S as functions of u. All three quantities hit zero at z/ = 1/2, where Ta = Tb'- nothing 
interesting happens when the system is maintained at a single temperature. Note also that 
V and Qa^b are opposite in sign (in agreement with Eq.|T^, while S is always nonnegative 
(in agreement with the Second Law). Finally, note that t> ^ as i/ — > 1 (Tb — > cxo). 

In plotting these two figures, we set all the internal parameters to unity: a = d = T = 1. 

II. NON-ZERO EXTERNAL LOAD 

In this section we add an external load to our model. In Feynman's example, this load is 
a flea, attached by a thread to the ratchet wheel: when the wheel rotates in the appropriate 
direction, the creature is lifted against gravity. In our model, we add a slope to the discrete 
potential: 

^M ^ jj(m) ^ ^^^^ ^22) 

where / is a real constant (and i is the lattice site); see Fig.^. Effectively, / is a constant 
external force which pulls the particle leftward if / > 0, rightward if / < 0. 

The presence of an external load allows the system to perform work. If, in the steady 
state achieved for fixed x = (/, Ta, Tb), the particle experiences a drift f (x), then the power 
delivered against the external load is: 

iy(x) = /t;(x). (23) 

By conservation of energy, this must be balanced by heat lost by the reservoirs: 

W = Qa- Qb. (24) 

Our approach to solving for the steady-state behavior is the same as in Section |, except 
that the presence of the term ifd in the potential changes the elements of 7^, and therefore 
the steady-state probabilities p. 
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Because the acceptance probability of an attempted move in the Metropohs scheme has 
the form Prob. = min{l,exp — Ai?/T}, each matrix element TZij is piecewise analytic in /. 
A little thought reveals that the /-axis can be divided into four ranges of values, over each 
of which the elements of 7^ can be written as analytic functions of a, d, f, Ta, and Tb- 
These ranges are: 



— oo < /< —a/d 
-a/d < /< 

< /< 2a/ d 
2a/ d < f< +00. 



(25a) 
(25b) 
(25c) 
(25d) 



In the two extreme ranges, (a) and (d), stretching to — oo and +00, the slope is so steep 
that the potential energy function no longer has a sawtooth shape in mode 2. We will ignore 
these ranges and focus instead on the ones for which U^ does look like a discrete sawtooth. 
For range (b), i.e. —a/d < / < 0, the potential slopes downward with increasing i, and 
an explicit expression for TZ is: 
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(26) 



(27) 



For range (c), < / < 2a/ d, the potential slopes upward with %, and we have 
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(28) 



Note that both 7^^ and VJ^ reduce to the matrix 7?. of Section |I|, when o" = 1, i.e. / = 0. 

As in Section |, the first order of business is to solve for p, using Jordan elimination, 
only now the process is considerably more tedious: terms do not cancel as nicely as when 
/ = 0. The final results for the steady state probability vectors p^ and p'^ (corresponding 
to the two ranges of / values) are of the form 



P^n 






J = b, c. 



n 



1---6, 



(29) 



where the P^'s are finite polynomials in the variables fi, u, and a, and A^-' = J2n=i ^l i^ a 
normalization factor. Explicit expression for the polynomials P^ are given in the Appendix. 
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v'{^) = 


3 ,^ X^ 


Ai^) - 




)i(x) = 


Y3 3 X^ 
= aT'. fdT \. 

NJ 2' aN3 



We can now obtain f (x), Qa(x), and Qb{^) from p, as in Section |I[ The results for the 
two ranges of / values, j = b, c, are: 

(30a) 

(30b) 

(30c) 

where X^{fi, u, a) and Y^{fi, u, a) are polynomials for which explicit expressions are presented 
in the Appendix. 

Note that the steady-state behavior described by Eq.^ clearly satisfies energy conserva- 
tion (see Eqs.|2^ and ^4]): 

Qa-Qb = fv. (31) 

Eq.^ is the central result of this paper (and reduces to the results of Section | when 
/ = 0). In Section |IT|, we use Eq.^to show that our model can act both as a heat engine 
and as a refrigerator. In Section |TV|, we consider the behavior of our system near equilibrium, 
and we use Eq.^^ to confirm predictions based on a general, linear response analysis. 

III. THE SYSTEM AS HEAT ENGINE AND REFRIGERATOR 

We can anticipate two different scenarios in which our system acts as a "useful" device: 

(1) W > 0. In this case, the system is a heat engine, causing the particle to drift up the 
potential energy slope, with efficiency r^eng = W/Q^, where Q> is the rate of heat flow out 
of the hotter reservoir. 

(2) ly < and Q^ > 0, where Q^ is the rate of heat flow out of the colder reservoir. 
Here the system is a refrigerator, with efficiency r^ref = Q</|W^|- The particle drifts down 
the potential slope, and the resulting energy liberated allows for a net transfer of heat from 
the colder to the hotter reservoir, without violating the Second Law. 

We will now use the results derived in Section to show that our simple model indeed 
exhibits both these behaviors. 

The system is a heat engine when f(/, Ta,Tb) and / are of the same sign. Let us 
introduce the variables 

P = ^^ (32) 



2T^Tj 



B 

Ta - Tb . . 

7 = , (33) 

-LA-LB 

and consider the behavior of our system in (/, 7)-space, for a fixed value of (3. (Note that (3 
is the average inverse temperature of the reservoirs, and 7 is the difference between inverse 
temperatures.) Because Qa, Qb, and v are mutually dependent (Eq.pT|), we can generically 
explore a measurable fraction of the space of steady-state behaviors by varying only two 
independent parameters, / and 7, while holding the third, (3, fixed. 
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In Fig.0 we plot the contour f (/, 7) = 0, having set P = I, and a = d = T = 1. (The 
range of 7 values for this choice of (3 is —2 < 7 < 2.) To the left of this contour, we have 
f > 0; to the right, v < 0. The shaded region thus represents the values of (/, 7) for which 
V and / are of the same sign, i.e. where the system behaves as a heat engine. 

We can understand the placement of the shaded region as follows. Consider a point P 
on the positive 7-axis: / = 0, 7 > (i.e. zero external load, T4 > Tb). From Section 
|, we know that the particle then drifts leftward, f < 0, although no work is performed, 
since / = 0. Let us now imagine tilting the potential slightly "downward" (/ < 0). For a 
small enough tilt, we expect that the particle will continue to drift to the left, but now this 
drift is uphill, and therefore work is done against the external load: W > 0. We conclude 
that points immediately to the left of the positive vertical axis will correspond to external 
parameters for which the system behaves as a heat engine, and Fig.|^ confirms this. (Similar 
reasoning applies for the negative 7-axis, where the region W > appears to the right.) If 
we now continue to tilt the slope more and more downward (/ increasingly negative), at 
fixed 7 > 0, we expect the leftward drift to become progressively slower, until for some tilt 
we get V = 0. At this point the leftward "thermal force" exerted on the particle due to 
the temperature difference between the reservoirs, exactly balances the external load. This 
occurs at the boundary of the shaded region (the contour v = 0): for more negative slopes, 
the particle slides down the slope, and the system no longer acts as a heat engine. 

Our system is a refrigerator when Q< > 0, where (5< is the rate at which heat leaves the 
colder of the two reservoirs. In Fig.| we plot the contours QaW,!) = ^'^^ Qsifjl) = 0, 
again for (3=1. These two contours are tangent at the origin, and divide the plane of 
(/, 7)-values as follows: Qa is positive for points lying above the contour, and negative 
below. Similary, Qb > {Qb < 0) for points lying above (below) the contour Qb = 0. 
Now, above the horizontal axis (7 > 0) we have T^ > Tg, hence Q^ = —Qb- The small 
shaded region in the second quadrant therefore represents values of (/, 7) for which reservoir 
B is the colder of the two reservoirs, and it is losing heat {Qb < 0). Hence in this region 
our system acts as a refrigerator. Below the horizontal axis, Tb > Ta and thus Q< = Qa- 
The larger shaded region in the fourth quadrant thus also represents refrigeration, only now 
reservoir A is the being drained of heat. 

We can understand the general shape of the shaded regions by assuming that, when the 
temperatures are equal (7 = 0) and the slope is very small, the quantities v, Qa, and Qb 
are linear functions of the slope: 

vif,0) = cJ + Oif) (34a) 

QAif,0) = CAf + Oif) (34b) 

QB{f,0) = CBf + O{f), (34c) 

with Cy, ca, cb 7^ 0. (Then Cy < 0, since the particle cannot slide up the slope when the 
reservoir temperatures are equal.) Energy conservation implies that the difference between 
Qa and Qb must be quadratic in / (since Qa — Qb = W = fv = Cyp), hence ca = cb- 
Thus, for equal temperatures and a sufficiently small slope, one of the reservoirs will be 
losing heat and the other will be gaining it. If we now slightly lower the temperature of 
the reservoir which is losing heat, then we have a refrigerator: heat flows out of the colder 
reservoir. In our model, we have c = ca = cb > 0, hence for points on the 7 = axis 
immediately to the right of the origin, heat flows out of reservoir A and into reservoir B; 
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immediately to the left of the origin the reverse holds true. This explains why, just to the 
right (left) of the origin, the shaded region corresponding to refrigeration hugs the horizontal 
axis from below (above). If we continue to the right along the line 7 = 0, increasing the 
value of /, then the particle will drift ever more rapidly to the left as the slope becomes 
ever more steeply inclined. The potential energy lost as the particle slides down the incline 
gets dissipated into the reservoirs; for sufficiently large /, the rate of dissipation is great 
enough that both reservoirs become heated: Qa < 0, Qb > 0. This happens to the right of 
the point at which the contour Qa = crosses the horizontal axis with a positive slope; for 
values of / beyond this point the system can no longer operate as a refrigerator. 

We can also understand why the two contours Qa = and Qb = "kiss" at the origin. 
The result ca = cb means that Qa and Qb are (to leading order) equal along the horizontal 
axis 7 = 0, near the origin. However, they are also (exactly) equal along the vertical axis, 
since W = when / = 0. Thus, Qa and Qb are equal, to leading order in / and 7, for a 
small region around the origin: Qa = Qb = cf + &7- This implies that their contours are 
both tangent to the line 7 = —cf/b at the origin. 

Since we have expressions for f(x), Qa(x), and Qb(x), we can compute the thermal 
efficiency r], when it acts as either a heat engine or a refrigerator. By the Second Law, 
these efficiencies must never exceed the Carnot efficiencies, r^^g and r/^f (which depend 
only on Ta and Tb). Ideally, we could use our exact results to find the maximum relative 
efficiency {y = tj/t]^) which our model achieves, both as a heat engine and as a refrigerator. 
Unfortunately, the expressions for f , Qa-, and Qb are sufficiently complicated that we are not 
able to find these maxima analytically. However, at the end of Section |^, we will present 
analytical results for the maximum relative efficiencies achieved when the system operates 
close to equilibrium. 



IV. LINEAR RESPONSE 

When / = and Ta = Tb = P~^, our system is in equilibrium, and there results no 
average particle drift or heat flow. In Section |Tl| we briefly considered the behavior of our 
system near equilibrium (see e.g. Eq.p3). We now consider this case in more detail. We will 



present a general analysis essentially the same as that of Jiilicher, Ajdari, and Prost |]13 
and then show that the exact results obtained for our model conflrm the predictions of this 
analysis. 

For a sufficiently small load / and inverse temperature difference 7, and a fixed value of /3 
(characterizing the inverse temperature of the equilibrium state around which we expand), 
we expect to be in the linear response regime: the particle drift and heat flows depend 
linearly on / and 7. Let us introduce the quantity 



UQa + Qb) (35) 



2 
roughly, a "heat flux" from A to B - and let us write, to leading order in /, 7: 

V \ ( dv/df dv/d'y \ ( f\ 



$ ; 1^ d<^/df a$/(97 J 



7 / ' ^''^ 
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with the derivatives of v and $ evaluated at equihbrium (/ = 7 = 0). As per the arguments 
given at the end of the previous section, Qa and Qb are equal, to leading order in / and 7, 
near equilibrium. 

The rate of entropy production is then: 



S 



Qa Qb_ 

'Ta Tb 




(/ 7) 



where Mn = -{3 dv/df, M^ = -p dv/d-f, M21 
equilibrium. The Second Law implies that 



det M > 0, 
whereas Onsager's reciprocity relation p4[ predicts that M12 



(37) 
d^/df, and M22 = d^/d^, evaluated at 

(38) 



M21, or 



-/3 



dv 
^7 



/=7=0 






(39) 



/=7=0 



Also, the diagonal elements of M must be positive: the particle must slide downth.e potential 
slope when the temperatures are equal (Mn > 0), and there must be a flow of heat from 



the hotter to the colder reservoir when the slope is zero (M22 > 0). Jiilicher et al. |13] have 
obtained identical results for a molecular motor driven by a difference in chemical potential 
rather than temperature. 

Using the exact results obtained in Section |I|, we differentiate v and $ with respect to 
/ and 7 to evaluate the elements of the matrix M for our modelQ: 



M 



3/52^2^(3 + 40 al3dC{l-C) 

al3dC{l-0 a2C[4 + C(29 + C)]/(4 + 3C) 



where 



c 



-0/3 



(0 < C < 1^ 



c 



3cr 



(16 + 5C)[1 + C(4 + C)] 



>0. 



(40) 



(41) 



The variable C, is akin to /i and v. it is the "rescaled temperature" of the equilibrium state 
with respect to which the linear response behavior is defined. Then 



detM 



%a(3CdTf{2 + 19C + 21(2) 
(4 + 3C)(16 + 5C)[l + C(4 + C)]'' 



(42) 



^ Recall that the expressions for t'(x), Q/l(x), and Qb{'^) differ according to the sign of /. We 
have verified that, regardless of whether we use the results valid for range (b) (/ < 0), or those for 
range (c) (/ > 0), we obtain the same results for the elements of M. 
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and we see by inspection that Mii,M22 > 0; that M12 = M21, as mandated by Onsager 
reciprocity (Eq.|39D; and that det M > 0, in agreement with the Second Law (Eq.p8|). 

It is interesting to consider the operation of our system as a heat engine and refrigerator, 
in the hnear response regime. In this regime, the conditions for these two behaviors are: 
vf > for a heat engine (as before), and 7$ < for a refrigerator (since $ = Qa = Qb, 
to leading order in /, 7). In Fig.^, the shaded regions indicate values of (/, 7) for which 
the system acts as a heat engine or refrigerator (compare with Fig. [2] of Ref. |[T^.) The two 
diagonal lines which form boundaries of these regions are given by f = and $ = 0. The 
slopes of these lines are: 

The Second Law, by requiring that detM > 0, guarantees that these shaded regions do not 
overlap: |A^=o| > |A#=o|- 

The efficiency of our system, when operating as a heat engine, is given by: 

W 

^eng = ^ (44) 

(again using $ = Qa = Qb to leading order). The Carnot efficiency defined for the tem- 
peratures Ta and Tb is: 



'(f« = ^i^i:^^ = ^ + 0(7^). (45) 



Then we can get an explicit expression for the relative efficiency {y = rj/rj^) of our system, 
in the linear response regime: 

^Ven,_ 1 Mn + M12A 

^^°^"cg" AM21 + M22A' ^^^^ 

where A = 7//. The relative efficiency is the same for all points along any straight line 
through the origin, and Eq.|^ gives that relative efficiency as a function of the slope A of 
the line. A similar analysis holds for the case of refrigeration: 



Vrei _ ^ M2l + M22\ 

r]g, Mn + MuX' 



_ '/ref , ^"-'21 -r ivi22^ / ,-,\ 

2/-f = -cr = -^T^r—TT^- (47) 



Note that y^ef happens to be the inverse of ?/eng, although the two expressions are valid for 
different ranges of A values, corresponding to the shaded regions in Fig.^. 

The results of the previous two paragraphs were derived with the implicit assumption 
that Mi2,M2i > 0. This happens to be true for our model, but in general these elements 
can be either positive or negative (or zero), so long as they are equal. If M12 and M21 were 
negative, then the shaded regions would occur in the the first and third quadrants of the 
(/, 7) plane, and the negative signs would not appear in Eqs.^ and ^. 

The above results imply that, near equilibrium, a microscopic device operating between 
two reservoirs either can act both as a heat engine and as a refrigerator (if M12 = M21 7^ 0), or 
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will exhibit neither behavior (if M12 = M21 = 0). For instance, in a microscopic ratchet-and- 
pawl device, if the sawteeth on the wheel have a symmetric shape, then the system cannot 
behave as a heat engine: M12 = 0, as is obvious by symmetry. What is not so immediately 
obvious, but follows from the condition M12 = M21, is that it is equally impossible for a 
system with symmetric teeth to operate as a refrigerator, in the linear response regime. 

Finally, for a given inverse temperature f3 of the equilibrium state, we can solve for the 
maximal relative efficiency achievable in the linear response regime, by maximizing ?/eng and 
l/ref with respect to A. It turns out that the maximal efficiencies are equal in the two cases, 
and depend only on a single parameter r characterizing the behavior of the system near 
equilibrium: 



.MAX MAX „.MAX ' ._//in M12M21 



^MAX ^ ^MAX ^ ^MAX ^ r{f3) = ^^^^ {0 < T < 1) . (48) 



The value of y^^^ increases monotonically as r goes from to 1. 
From Eq.|^, we find that our model gives: 

(1-0^(4 + 30 



(49) 



3(3 + 4C)[4 + C(29 + 9C)] 

which depends only on the rescaled temperature ( = exp(— a/5) of the equihbrium state. In 
Fig.|TD| we plot r{(). We see that r approaches a limiting value of 1/9 as the equilibrium 
temperature T = /5"^ goes to zero (i.e. ( —>■ 0), and decreases to zero as T -^ cxo (i.e. ( -^ 1). 
For the limiting value r = 1/9, our model gives a maximal relative efficiency 

yMAx^j. ^ 0) = ^ — j= ^ 0.0294. (50) 

17 + 12 v2 

This is the best relative efficiency which our system can achieve near equilibrium. 

We have carried out a cursory numerical search - 10^ points sampled randomly in 
(/, /i, z/)-space - and have found, away from, equilibrium,, relative efficiencies as high as 
y ^ 0.0432 (heat engine) and y ~ 0.0647 (refrigerator). These are greater than the near- 
equilibrium value quoted in Eq.^, but still far short of unity. This suggests that the effi- 
ciency of our model is always considerably lower than the corresponding Carnot efficiency. 
Such a conclusion is in agreement with Parrondo and Espanol ||19|, and Sekimoto |2^, who 
have argued that Feynman's analysis on the point of efficiency - in which he concluded that 
the ratchet and pawl would operate at Carnot efficiency - was in error. We note also that 
Hondou and Takagi |^, as well as Magnasco and Stolovitzky p^, have shown that, within 



a Langevin model for two degrees of freedom (e.g. the ratchet and pawl) coupled to two 
different heat reservoirs, Carnot efficiency cannot be achieved. 

V. SUMMARY 

Our aim in this paper has been to introduce a discrete model of Feynman's ratchet and 
pawl, and to solve exactly for the behavior of that model as a function of external load (/) 
and reservoir temperatures (T4, Tb). The central result, Eqs.^, gives the average directed 
motion (t>) and heat flows {Qa, Qb), in the steady state. We have shown that our model 
can act both as a heat engine and as a refrigerator, and we have investigated its behavior 
in the near-equilibrium, linear response regime. 
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APPENDIX 

Here we present explicit expressions for the polynomials P^, X^ , and Y^ appearing in 
Section |T[ The P^'s are obtained by Jordan elimination, performed on the matrices TZ^ , 
J = b, c; and Xj and Yj then follow from Eqs.|l|,|l|,|l|,|l3, |2|, and |0[ 

Pi; = i/V(l + a + 3a^) + ua^iA + 3/i + (4 + /i)(l + 2fi)a + (4 + 3/i(3 + 2fx))a^) 

+Afia{3 + cr(5 + 3/i + 5cr + 4/icr)) + z/^(4 + a{A + 2fi + a{Q + a + a'^ + 3a^))) 

p| = T,a^(4: + 3/i + (12 + 7fx)a + (12 + /i(15 + 2fx))a^) + u'^{A + 2(6 + /i)(T + 6(1 + /x)^^ 
W + 3a^ + a^) + z/V(l + a(3 + a)) + 4/ia(3 + or(3 + /x + 3(1 + /i)a)) 

Pi = 4/ia(3 + or(5 + 3a)) + z/V(l + a{5 + 9a)) + ^^(4(1 + a + 3a^) 
+/i(3 + a{9 + 7a))) + u'^{A + a{l2 + ct(18 + a + Sa^ + 9a^))) 

Pi = a(16 + 4(6 + v)a + 6(4 + v)a'^ + IOz/ct^ + /i(4 + ct(20 + z/ + 24(t + 5z/a + 9z/a^))) 

Pi = j,'^{A + /i + 5(2 + fi)a + 3(2 + 3^)a'^) + 2/ia(4 + /x + (4 + 3/i)a + (4 + S/i)^^) 
+2z/a^(4 + /i + (8 + 5/i)CT + (8 + 9/i)(T^) 

Pi = 2fiua^{2 + /x + (2 + 3/x)a + (4 + 3/i)a^) + 2/xV(3 + a{5 + 3a)) 

Wa{2 + 4a(l + a) + /x(l + or(5 + 9a))) + 2/^(4 + 6a + 2a'^{3 + a(l + 2(t(1 + a))) 
+/i(3 + a(ll + a(15 + a + Sa" + 9(7^)))) (51) 

X^ = z/V(-l - 2a + 3^3) + z/o-2(-4 - 3/i - 2/ia + Afxa^ + 3(4 + /i(5 + 2fi))a^) 
W{-A - 3(4 + /i)a - 3(4 + 3/i)(T^ - (1 + 9/i)a^ + (2 + /i)a^ + (6 + 5/i)a^ 
+ (13 + 9/i)a^) + 2/xa(-6 + a(-4 + 6^^ + 3/i(-l + (-1 + a)a))) 

Y^ = -(z/V(3 + (t(5 + 7a)) + ua^{-2f?{l + a)(l + 2a) + /i(-l + (3 - 5a)a) 
+4(1 + a + a')) - 2/ia(2(l + a + a') + /i(5 + a(9 + 7a))) 
+u\8 + /i(-l + a - 3a2) + a(10 + a(12 + a(3 + a(5 + 7a)))))) (52) 



P^ = u^a{l + a(3 + a)) + 4/xa(5 + /i(5 + 2a) + a(5 + 3a)) + z/a2(2/i2(3 + a) 
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+4(1 + (r + (r^) + 3^(3 + a{3 + a))) + u^A + 2/i + a(6 + (r{4 + a + 3a^ + a^))) 
P| = z/V(3 + a + a^)+ Afia{fi + 3/ia + 3(1 + ct + a^)) + ua^{2fi^a + 4(3 + ct(3 + a)) 

+12(15 + a{7 + 3a))) + z/2(12 + 2/i(3 + a) + a(6 + a(4 + a{3 + a + a^)))) 
P| = 4/ia(5 + 3a{l + a)) + z/'V(9 + a(5 + a)) + ua^{A{l + a{3 + a)) 

+/i(9 + a(7 + 3a))) + z/2(16 + a(14 + a{A + a(9 + a{5 + a))))) 
P^^ = a(24 + 2a(3 + 2a){A + u + va) + ^(28 + a(4(4 + a) + z/(9 + a(5 + a))))) 
P^ = 2/ia(4(l + CT + ^2) + ^(3 + a{5 + ct))) + //^(lO + 6a + 4a=^ + /i(9 + a{5 + a))) 

+2z/a2(4(2 + a{2 + a)) + ^(9 + a{5 + a))) 
Pg^ = 2^V(5 + 3a(l + a)) + 2/iz/c72(2(l + a)^ + ^(3 + a(3 + a))) + z/V(2(2 + a{2 + a)) 

+^(9 + a{5 + a))) + z/2(2(3 + a{3 + a(2 + a{2 + a(2 + a))))) 



+/i(15 + a(ll + a(3 + a{9 + a(5 + a)))))) 



(53) 



X^ = (j(z/ff^(-4 -5i2 + 412(2 + /x)a + 2(2 + ;u)V^ + (4 + 3/i)CT^) + iy\-3a + 2a'^ + a 

+2/ia(-10 + 6(7-'^ + fi{-5 + a(-l + 3^))) 

+z/2(-22 + ^(-15 + a{-5 + a{-l + a{9 + a(5 + a))))) 

+a{-8 + a(-2 + a{7 + a(10 + a(6 + a))))))) 
Y^ = -(z/V(5 + a{7 + 3ct)) + ua^{A{l + a + a^) - 2fi^{3 + a{2 + a)) 

-l2{-3 + a(5 + a))) - 2^a(2(l + a + a") + /x(9 + a(7 + 5a))) 

+z/2(10 - /i(-l + (t(3 + a)) + a(12 + a{8 + (7(5 + a(7 + 3a)))))) 



(54) 
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FIGURES 

FIG. 1. The potential energy U^ is shown for both modes, m = 1,2, in the absence of an 
external load; the lattice spacing is d, and site 1 is labelled explicitly. 

FIG. 2. Our system maps onto that of a spin-1/2 particle (A) coupled to a spin-1 particle {B). 
The former is depicted in the usual manner (as "up" or "down" ) , the latter by an arrow which can 
point in one of three directions on the face of a clock. The thin lines denote the coupling between 
the two spins, as well as the coupling of each spin to a heat reservoir. 

FIG. 3. A schematic representation of our system (S) in contact with two heat reservoirs (at 
temperatures T^ and Tg). As implied by the arrows, we define Qa to be the net fiow of heat from 
reservoir A to the system, and Qb to be the heat flow from the system to reservoir B. Therefore 
W = Qa — Qb is the power delivered as work against an external load. (In Section |, there is no 
such load, hence Qa = Qb-) 

FIG. 4. A contour plot of the function v{fj,,i'), where /i = exp(— a/T^) and u = exp(— a/Tg) 
are the rescaled temperatures of the two reservoirs. 

FIG. 5. The drift v (multiplied by 10), heat fiow Qa^b, and rate of entropy production S, 
plotted as functions of u, for fixed ^ = 1/2. 

FIG. 6. The discrete, two-mode potential energy function U^ is illustrated for the situation 
in which there is a non-zero external load. Here we have chosen / = a/ Ad. 

FIG. 7. The contour w(/, 7) = is shown, for fixed average inverse temperature (3 = 1. The 
shaded regions are those for which fv > 0, i.e. for which the system behaves as a heat engine. 



FIG. 8. The contours QaH, 7) = and QbH, 7) = are shown, for fixed (3 = 1. In the shaded 
regions, there is a net fiow of heat out of the colder reservoir; the system then acts as a refrigerator. 

FIG. 9. General predictions based on linear response. The shaded regions adjacent to the 
vertical axis indicate the values of (/, 7) for which the system behaves as a heat engine; those 
adjacent to the horizontal axis indicate that the system is a refrigerator. The diagonal lines 
bounding these regions are the contours v{f,j) = and $(/, 7) = 0. This figure essentially 
combines Figs.0 and |8|, for near-equilibrium values of /, 7 ~ 0. 

FIG. 10. The quantity r{() is plotted for the entire range of values of the (rescaled) equilibrium 
state temperature (0 < C < !)• 
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